14 research outputs found
Differentiable Graph Module (DGM) for Graph Convolutional Networks
Graph deep learning has recently emerged as a powerful ML concept allowing to
generalize successful deep neural architectures to non-Euclidean structured
data. Such methods have shown promising results on a broad spectrum of
applications ranging from social science, biomedicine, and particle physics to
computer vision, graphics, and chemistry. One of the limitations of the
majority of the current graph neural network architectures is that they are
often restricted to the transductive setting and rely on the assumption that
the underlying graph is known and fixed. In many settings, such as those
arising in medical and healthcare applications, this assumption is not
necessarily true since the graph may be noisy, partially- or even completely
unknown, and one is thus interested in inferring it from the data. This is
especially important in inductive settings when dealing with nodes not present
in the graph at training time. Furthermore, sometimes such a graph itself may
convey insights that are even more important than the downstream task. In this
paper, we introduce Differentiable Graph Module (DGM), a learnable function
predicting the edge probability in the graph relevant for the task, that can be
combined with convolutional graph neural network layers and trained in an
end-to-end fashion. We provide an extensive evaluation of applications from the
domains of healthcare (disease prediction), brain imaging (gender and age
prediction), computer graphics (3D point cloud segmentation), and computer
vision (zero-shot learning). We show that our model provides a significant
improvement over baselines both in transductive and inductive settings and
achieves state-of-the-art results
Precise Proximal Femur Fracture Classification for Interactive Training and Surgical Planning
We demonstrate the feasibility of a fully automatic computer-aided diagnosis
(CAD) tool, based on deep learning, that localizes and classifies proximal
femur fractures on X-ray images according to the AO classification. The
proposed framework aims to improve patient treatment planning and provide
support for the training of trauma surgeon residents. A database of 1347
clinical radiographic studies was collected. Radiologists and trauma surgeons
annotated all fractures with bounding boxes, and provided a classification
according to the AO standard. The proposed CAD tool for the classification of
radiographs into types "A", "B" and "not-fractured", reaches a F1-score of 87%
and AUC of 0.95, when classifying fractures versus not-fractured cases it
improves up to 94% and 0.98. Prior localization of the fracture results in an
improvement with respect to full image classification. 100% of the predicted
centers of the region of interest are contained in the manually provided
bounding boxes. The system retrieves on average 9 relevant images (from the
same class) out of 10 cases. Our CAD scheme localizes, detects and further
classifies proximal femur fractures achieving results comparable to
expert-level and state-of-the-art performance. Our auxiliary localization model
was highly accurate predicting the region of interest in the radiograph. We
further investigated several strategies of verification for its adoption into
the daily clinical routine. A sensitivity analysis of the size of the ROI and
image retrieval as a clinical use case were presented.Comment: Accepted at IPCAI 2020 and IJCAR
Latent Graph Inference using Product Manifolds
Graph Neural Networks usually rely on the assumption that the graph topology
is available to the network as well as optimal for the downstream task. Latent
graph inference allows models to dynamically learn the intrinsic graph
structure of problems where the connectivity patterns of data may not be
directly accessible. In this work, we generalize the discrete Differentiable
Graph Module (dDGM) for latent graph learning. The original dDGM architecture
used the Euclidean plane to encode latent features based on which the latent
graphs were generated. By incorporating Riemannian geometry into the model and
generating more complex embedding spaces, we can improve the performance of the
latent graph inference system. In particular, we propose a computationally
tractable approach to produce product manifolds of constant curvature model
spaces that can encode latent features of varying structure. The latent
representations mapped onto the inferred product manifold are used to compute
richer similarity measures that are leveraged by the latent graph learning
model to obtain optimized latent graphs. Moreover, the curvature of the product
manifold is learned during training alongside the rest of the network
parameters and based on the downstream task, rather than it being a static
embedding space. Our novel approach is tested on a wide range of datasets, and
outperforms the original dDGM model
Multi-Head Graph Convolutional Network for Structural Connectome Classification
We tackle classification based on brain connectivity derived from diffusion
magnetic resonance images. We propose a machine-learning model inspired by
graph convolutional networks (GCNs), which takes a brain connectivity input
graph and processes the data separately through a parallel GCN mechanism with
multiple heads. The proposed network is a simple design that employs different
heads involving graph convolutions focused on edges and nodes, capturing
representations from the input data thoroughly. To test the ability of our
model to extract complementary and representative features from brain
connectivity data, we chose the task of sex classification. This quantifies the
degree to which the connectome varies depending on the sex, which is important
for improving our understanding of health and disease in both sexes. We show
experiments on two publicly available datasets: PREVENT-AD (347 subjects) and
OASIS3 (771 subjects). The proposed model demonstrates the highest performance
compared to the existing machine-learning algorithms we tested, including
classical methods and (graph and non-graph) deep learning. We provide a
detailed analysis of each component of our model